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ABSTRACT 
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taslcs — two designed to measure cognitive dimensions (e.g., 
categorizing countries and categorizing action verbs) and one 
developed to tap personality differences (e.g., traits associated 
with assertiven^ss)~the study sought to understand how individuals 
group and structure stimuli. Specifically, tho F-sort categorization 
technique and latent partition analysis (LPA) were used to evaluate 
the data collected. Fifty undergraduate preservice teachers performed 
the first two sorting tasks, and 45 education students performed the 
personality task. The first task consisted of sorting a random sample 
of 30 nations, the second sorting ta \ consisted of a set of 
statements/items from a self-reporting questionnaire designed to 
measure the attributes needed to achieve personal success, and the 
last task consisted of a set of verbs. A deck of cards was 
constructed for each of the tasks: 100 decks for the 30-country sort, 
and 50 decks for sorting the 50 verbs and the 30 statements. The 
reliability indices provided insight as to how the stimuli, for each 
task, were clearly related to the corresponding latent partition. The 
use of theta reliability procedures in LPA appears to be justified 
given the nature of the tasks usually involved in this methodology. A 
49-item list of references, 12 data tables, a list of stimuli 
description names for sorting tasks, instruction forms for the 
sorting tasks, and sample data '^ts for generating joint proportion 
matrices are provided. (RLC) 
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Abstract 

The purpose of the present investigation was to illustrate 
the applicability of categorization methodology for a number of 
empirical situations and to draw implications regarding the use 
of such met^->dology in examining categorical data. In using 
three tasks, two designed to measure cognitive dimensions (e.g. 
categorizing countries and categorizing action verbs) and ons 
developed to tap personality differences (e.g. traits associated 
with assert iveness) , we sought to iinderstand how individuals 
group and structure stimuli. Fifty undergraduate preservice 
teachers were szunpled to performed the first two sorting tasks 
and 45 education students for the personality task. The 
application of this methodology was empirically justified in each 
of the sorting tasks. The reliability indices provided an 
insight as to how the stimuli, for each task, were clearly 
related to the corresponding latent partition. 
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APPLICATION OF CATEGORIZATION METHODOLOGY IN VARIOUS 

TESTING SITUATIONS 

Introduction 

Generally, when educational practitioners and 
researchers set out to understand academic abilities or 
personality traits, they administer a series of tests to 
their studex/^.s. In the case of academic achievement and 
aptitude, these tests might take on a multiple-choice or a 
short answer format. For personality inventories, 
respondv^nts may be asked to respond to a saries of Likert- 
type statements. Whether intellectual or affective, these 
measures exemplify modes of assessment that are objective 
and researcher-controlled. When these instruments are 
reliable and vnlid, they have afforded investigators ease 
in administration and scoring. Furthermore, responses are 
typically easy to code into categories and therefore 
statistical analysis and interpretation is facilitated. 
However, do these standard means of evaluation present the 
most sensitive manner in which one can gain information 
regarding individual differences? That is, are these 
objective formats the most infonnative way of 
differentiating between experts and novices, gifted and 
nongifted learners, depressed and nondepressed individuals, 
etc.? 

Schuell (1985) argued that perhaps the most 
informative means of understandirig thought and behavior was 
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throujh the use of interview techniques or verbal report 
data. These methodologies are extremely siibjective in that 
they permit the respondent to axiswer in any fashion that 
he/she chooses. While one might gain a great number of 
insights regarding the cognitive processing of a student or 
the emotional trauma of a depressed child, interview 
techniques or verbal report data receive psychometric 
criticism because it is most difficult to obtain a 
reliability estimate on the data gathered. Furthermorei it 
is extremely difficult to code the data suitably for 
statistical analysis (White, 1985) . 

Thus, within the continuum of objective (e.g., 
multiple-choice, Likert scale) and subjective (e.g., 
interview techniques) assessment formats, is there a 
methodology that highlights more of the idiosyncratic 
natures ot individuals* processing yet can be reliably and 
validly assessed? One alternative rests in the broad realm 
of categorization methodology. Most often these 
categorization techniques involve the sorting of stimuli 
cards. Unlike objective tests, the individual may group 
cards in any irtanner that makes sense to him/her rather than 
being directed to select a single response from a series of 
alternatives across a number of items. Unlike interview 
techniques, categorization methodology provides more well- 
defined parameters around which a researcher can code an 
analyze data (Schuell, 1985). For the respondent, 
categorization methodology may provide better guides ar to 
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what type of information is desired in an answer. As early 
as 1956, Bruner stated that categories ''make the 
environment ©ppear less complex" (p. 20), they ^'enable one 
to relat€» different classes of events** (p. 21). In 
essence, categorization for both researcher and respondent 
provide greater control in organizing and structuring 
information. 

For example, categorization methodology has been 
extremely useful in the cognitive literature where attempts 
have been made to discern che processing differences 
between expert and novice performance in a variety of 
domains. Chi, Feltovich, and Glaser (1980), Shavelson and 
Stanton (1984) have effectively used categorization 
methodology to determine how physics experts and novices 
approach a variety of problems. Results indicate that 
experts most commonly sort problems according to principles 
such as the Law of Gravity or the properties of centrifugal 
force. Novices, on the other hand, often sort problems 
according to what are considered "surface features." That 
is, novices pay attention to the types of equipment used in 
certain physics problems (e.g., weights or pulleys) or how 
much mass or energy is presented in the given problem. 
While an expert and a novice could have obtained similar 
scores on an objective measure such as a multiple-choice 
test, the categorization methodology often presents the 
expert as possessing not only greater but also much better 
organized knowledge. The novice, on the other hand, may 
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categorize information more loosely and in a more 
fragmented fashion. 

It would seem that categorization methodology would 
also be extremely valuable to those studying affective 
aspects of individuals. While an individual may respond 
"strongly agree" to a certain Likert item, one might not 
know exactly to what extent this individual feels so 
strongly aibout the topic. Furthermore, is there one item 
to which this individual responds that more sensitively 
depicts an issue of great pertinence to this person than 
some other issue? As for interviesf techniques, the 
respondent may not be capable to describe fully how he/she 
feels (Schuell, 1985). Again, categorization methodology 
may be the best alternative of giving researcher and 
respondent a better 'framework of collecting and providing 
information. 

Given that sorting techniques may suitably provide 
data about a reservoir of multifaceted processes, are there 
appropriate ways in which the data collected can be shown 
to be both reliable and valid? Such is the aim of the 
present investigation. In this study, we chose to examine 
how a series of categorization methods could be used to 
gather information about individual characteristics. For 
three tasks, two designed to measure cognitive dimensions 
and one developed to tap personality traits, we sought to 
understand how individuals would group together and 
structure stimuli. Specifically, we used the F-sort 



categorization technique and Latent Partition Analysis to 
evaluate the data that we collected. Before describing the 
methods and results of our study ^ we first provide an 
overview of the F-sort technique and latent partition 
analysis which are integral components of categorization 
methodology. 

Categorization Methodology 
As presented in the introduction, categorization 
methodology evolved to satisfy a need in the area of data 
collection and data reduction. The F-sort technique is 
used to collect data of the type required for analysis when 
using this methodology. The LPA technique is employed to 
summarize the data obtained from the F-sort task. 

F-sort Technique 
The F-sort technique is a method used for observing 
and recording categorical judgments manifested when 
subjects, acting as judges, conduct a series of sorting 
manipulations of a given set of objects. Typically, the 
subjects are provided with a deck of cards, which contain 
some type of stimuli that are supposed to be sorted Into 
Independent and exhaustive categories. Standard 
Instiructlons are provided to each of the judges. These 
Instiructlons contain pertinent Inforaatlon and a set of 
criteria about what Is sought by the researcher and what Is 
expected of the sorter. Basically, the judges are 
Instructed to sort the stimuli, given on the cards. Into 
disjoint categories of their own Invention. There are no 



restrictions on the total ntunber of categories or piles to 
be used, or on the number of objects that may be sorted in 
each category. Also, no a priori ordering of the category 
is assumed in the F-sort categorization task. The judge is 
free to decide on the homogeneous characteristic that the 
set of objects seem to possess. 

This lack of restrictions in the F-sort technique 
implies also that there is no set standard in which the 
judges may base their observations (in this case their 
sorting of the stimuli) . The F-sort technicpie is not 
supposec to be confused with the term Q-sort (Stephenson, 
1953) • The F-sort has been coined following the format of 
the Q-sort technique, but Its methodology is dissimilar to 
Q-sort technique. The Q-scrt technique involves 
assigning stimulus objects or items to fixed categories 
ordered along a predetermined dimension while F-sort is a 
free sorting technique, and the end result is a set of 
stimulus categories completely defined by the judge 
(sorter), (Miller et al., 1986). 

Latent Partition Analysis 

Latent partition analysis is the complementary 
technique employed in the categorization methodology to 
su^amarize the data obtained from the F-sort t'lsk. The LPA 
is a mathematical model for the sorting manipulations 
together with a computational algorithm for identifying 
the latent structure of the pooled sortings of several 
judges. LPA is, to some extent, similar in intent to 
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various existing procedures, such as latent structure 

analysis (Lazarfeld & Henry, 1968) ; however, the 

mathematical models are not quite the same. 

The latent partition model Is briefly explained next, 

following Its author's original development. As stated by 

the developer of the LPA model: 

^Latent partition analysis has been formulated 
to study the relationships between two or more 
partitions of the same set of Items. A partition 
of a set of objects Is a division of the set 
into Independent, exhaustive categories. 
The data * for latent partition analysis is a 
sequence of different partitions of the same 
set of items; and the basic structural hypothesis 
Is that there is a latent partition which 
underlies the manifest partitions", Wiley (1967). 

Latent partition analysis enablei* the examination of the 

modal population categorizations for a set of objects. One 

assumption made by Wiley is that for a given set of judges 

there exists a latent categorization or partitioning of 

objects presented. He assumed that the items are to be 

assigned to manifest categories according to independent, 

discrete probability distributions. The distributions are 

assumed to vary adross items and across manifest 

partitions, but otherwise are invariant within a given 

manifest partition for items belonging to a given latent 

partition. A manifest partition is represented by the 

matrix with rows corresponding to categories and columns 

corresponding to objects. The (m,j)th entry is 1 if object 

j is included in category m, and 0 otherwise. An example 

of a manifest partition matrix is the following: 
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11100000000 d" 

Zj^« 000111100000 
JD 0000001111 1_ 
where the number of objects, K, is equal to 12; and the 
nxunber of manifest categories, Mj^, is equal to three • 

The elements in the above matrix indicate that 
manifest category one consists of objects one, two, and 
three; manifest category two consists of objects four to 
seven inclusive; and manifest category three is made up of 
objects eight to twelve. 

The latent partition, which is tinobservable, is 
represented by ^ and also has a structure similar to Z^. 
A major asstiaption is that the matrix is assumed to be 
constant across all the judges or sorters. The matrix fli 
consists of probabilities that relate manifest partition i 
to the latent partition (j) . The (m,u)th element of Hi is 
the probability that any item from latent category u is 
included in manifest category m of partition i. The matrix 
TTj^ is assumed to remain constant over independent 
partitionings of objects by any sorter or agent of 
partitioning as identified by Wiley (1967). Wiley further 
argued that the manifest categorization of any judge, i, 
may be derived and represented from the latent 
categorization in the following way: 

E(Zi) -TTi^> (1) 
where the expectation is over the transformation into 
the sample space of all possible partitions of the items, 
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and TT i det«nDin«8 the probability distribution of tha 
partitions. The distribution for each of the items is 
assumed to be multinonial with probabilities determined by 
the colximn o'lTTi corresponding to the latent category to 
which the object or stimuli belongs. The assignments are 
to be exhaustive and mutually independent. It was 
previously mentioned that the latent partition matrix is 
unobserv«a>le and the manifest partition matrix generated by 
each judge will be used to generate an approximate 
structure for the latent partition matrix. This is 
achieved by first obtaining the squared matrix Sj^ defined 
by 

Si - Zi*Zi (2) 
where Sj^ is a matrix of item joint occurrence. The product 
of these matrices yields a square matrix indicating 
membership of an object to a particular category. In other 
words, is a matrix which consists of submatrices vith 
entries consisting of all ones. For the example provided 
above, the joint occurrence matrix will look as follows 

liioooooooodl 

111000000000 
111000000000 
000111100000 
000111100000 
000111100000 
000111100000 
00000001 
00000001 
00000001 
00000001 
P 0000001 

As observed from the example given there has been some 



ERIC 



12 



10 

arranging of th^ objects, this was done deliberately to 
111 istrate the membership of each Item to the particular 
category created by the sorter. But even If this nice 
ordering was not done^. the dIagonCil entries of are 
Identically 1. He want to find the expectation of which 
may be written as ^ • The elements in ][] are 
probabilities of joint occurrence for a pair of Items. 
This leads to the definition of the LxL matrix 

Hi -TTi'TTi (3) 

where the (u,v)th entry otCl^ is the probaJt>lllty of joint 
occurrence for any pair of distinct items from latent 
categories u and v. The square matrix ^*i7<i> # v!iich is 
similar in form to the square matrix S^, is considered to 
describe the probability of membership for a pair of 
objects in the same latent category. The desired 
probabilities of joint occurrence are found in the 
matrix off-diagonal entries. These off-diagonal elements 
are similar to the ones in ^ j^. Therefore, the KxK matrix 

A^i - Di - i>'^ii> (4) 
is a diagonak of "^diversities" . Thus, Irom (4) we have a 
representation of the expectation of as follows 

E(Si) - Zi - <f>*ni4> + A^i, (5) 
rhere the expectation is conditional on the sorter. 

In order to estimate II^, the Information obtained by 
each joint occurrence matrix is used to form a KxK joint 
proport\on matrix S defined as 

S - F Si (6) 
where the (j,k)th entry of S is the proportion of ^ 

o i 3 
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partitions in which items j and k were included in the same 
category* The derivation of the axpectation of S, leads to 
the final representation of the expectation of S 

z - 4>'n$> + A^- (7) 

Wiley shoved how ^ and ^ can be reconstructed by 
using concepts from factor analysis developed by iarris and 
Kaiser (1964) when it is Icnown that the transpose of ^ has 
independent cluster structure* He further argues that the 
use of the cpaarcimax procedure appears to be sufficient for 
the present purpose since the raw guartimax criterion value 
is maximized when independent cluster structure is 
achieved. Wiley also offers an algorithm fo ; the 
estiiaation of Z • Since ^ is not known, S must be used as 
an estimate of E , (see Wiley 1967 pp. 188-189) • Using a 
more direct approach , Pruzek (1968) considered the 
parallels that exists between LPA and the common factor 
analysis model and a special case of conventional common 
factor analysis, viz., alpha factor analysis (Kaiser & 
Caffrey, 1965). Pruzek claims that using this algorithm 
leads to more positive conclusions than the ones obtained 
by Wiley* s iterative algorithm* He emphasized that the 
**Kai8er-Caffrey rule for determining an appropriate number 
of alpha factors is justified in terms of maximizing common 
factor general izability (internal consistency) as measured 
!:y Cronbach*s (1951) coefficient alpha* It was found that 
Guttman's (1953) weaker lower bound for the numbe" of 
conmon factors gives the number of alpha factors which have 
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positive correlations (covariances) with a postulated 
universe of connon factors**, (Pruzek, 1968). According to 
both Wiley and Pruzek, Guttman*s weaker lover bound 
corresponds to the number of roots in the initial 
correlations matrix R which are greater than unity leading 
to the approximate number of latent categories in LPA. The 
difference, of course, is that in latent partition analysis 
the initial matrix S is a matrix of cross-products or 
proportions and not a matrix of correlations, Pruzek 
(1968). The LPA tachnique has been expanded to include 
more than one latent partition (Evans, 1970) and its 
transformation procedure has been improved by Hofmann 
(1987) . 

Categorization Methodology in Applied Research 

Categorization methodology has been applied in a 
variety of studies since its development. k3 already 
cited, Pruzek (1963) employed categorization m^.thodology to 
exaunine mathematics achievement test items. He made 
theoretical and empirical comparisons between LPA and 
conventional factor analysis. He found that despite the 
apparent meaningfulness of derived item categories within 
each study, it was found that there is little 
corre^^pondence between response d< ta groups and derived LPA 
categories. 

Two additional studies similar to Pruzek* s, were those 
of Hartke (1978, 1979). Hartke used latent partition 
analysis to examine a conceptually homogeneous population 
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of mathematics achievement items. He also used LPA in the 
development of conceptually independent sub-scales to reach 

i 

a consensus of student's judgments. 

Developmental stages of children's word meanings were 
investigated by Naguire, Patsula, and Evanechko (1975) 
while Conry (1973) studied the relationship between 
;4timulus task characteristics to cognitive styles. Whitely 
(1976, 1977) analyzed the effects of task properties on the 
solution of verbal analogy items. As reported in Miller et 
al., (1986), Lane (1967) examined the kinds of 
classifications that counselors constructed for client 
Statements. Willson and Palmer (1983) studied the 
categories that undergraduate students formed of 
attributions for examination perfojniiance. Colleta and 
Gable (1975) used categorization methodology to generate 
conten^^ categories from judgmental data gathered on Berth 
Scale items from twenty-three open education experts. 
While Colette and Gable studied the views of teaching at 
the elementary level. Diamond (1980, 1983) examined these 
views at the secondary school level and Whitely and Doyle 
(1976, 1978) at the college level. Haxcbleton and Sheehan 
(1977) de^'^ribed the categorization methodology and applied 
it to one segment of an objective-based science program. 
Rideng and Schibeci (1984) y«ed categorization methodology 
to examine the conceptual structure for an attitudinal test 
related to biology. Finally, Weitman (1986) investigated 
the hierarchies of effective early childhood teacher 
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dimensions as perceived by directors, parents, and 
caregivers* 

As it can be seen, the categorization methodology is 
not just used in one single area of study; it has been used 
on the development of new instruments and the improvement 
of existing ones* Categorization methodology can be 
utilized to improve curriculum systems in education. Its 
broad range of utility and flexibility makes it a desirable 
method to use for exploration and confirmation of 
underlying latent structures for sets of stimuli or 
phenomena* Despite the successful implementation of this 
methodology, there is still a lack of some kind of measure 
that may indicate the level of accuracy and consistency 
(agreement) that may exist amon^ the sorters who create 
tlie several distinct categories* The following section 
deals briefly with the possible adaptation of such a 
measure* 

Reliability of Composites 
ReliaU)ility measurement of composite variables has 
been defined as a total score based on two or more subtests 
jcores* Composite reliability has attracted a considerable 
amount of attention and interest among researchers in 
education, psychology, and sociology. Lord & Novick, 
(1968) and Armor, (1974)* This procedures have been 
applied to current instruments which are made up of more 
than one component* For example, the WISC-R and the K-ABC 
are just two of countless number of instruments that are 
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made of more than one component to measure Intelligence. 
These tests have employed composite reliability procedures 
to determine the internal consistency of their different 
parts or components, Willson & Reynolds, (1984, 1985). 

Alpha Reliability 

In the present section, a brief review of the 
development of composite reliability is introduced and 
explained as well as the maximization of the alpha 
coefficient for internal consistency called theta by Armor 
(1974). Two other similar measures have been developed. 
Heise and Bohmstedt*s (1970) coefficient omega and 
Bentler*8 (1968) alpha coefficient. These coefficients 
will not considered here since their developmental 
approach is different from Armor* s theta. 

Due in part to the conceptual and computational 
simplicity of the split-half method, this coefficient was 
the most commonly used coefficient before Cronbach 
introduced the coefficient alpha which he proved to be the 
mean of all possible split-half reliabilities, Cronbach, 
(1951). Novick and Lewis (1967) proved that alpha was a 
lower bound to the true reliability which means that alpha 
is a conservative estimate of the reliability of a 
composite. In his review. Armor (1974) gave several 
computational forms for alpha and some instances of 
situations in which one form of alpha is more appropriate 
than the other. He adds that, since real data depart most 
of the cases from the parallel-item assumptions, it is 



16 

necessary to decide on the adequacy of individual items. 
Under the parallei-assumptions, the more items the 
composite has the higher the reliability, except that when 
items do not correlate moderately high with other items in 
a composite, then reliability may be reduced and the items 
can be excluded. Armor defines the composite reliability 
alpha as 

« - [p/(p - 1)](C/S) (8) 
where S » the variance of the sum; C ■ the covariance 
between items i and j ; and p • the number of items in the 
composite. That is, alpha can be derived as the proportion 
of scale variance due to item covariation adjusted to 
provide an upper limit of 1. He provides other 
computational forms for alpha. He claims that the 
different formulas for alpha are not just a matter of 
computational convenience and offers three considerations. 
He also pointed out some limitations for coefficient alpha 
when composites measure more than one independent 
dimension. 

Theta Reliability 
In order to maximize the alpha reliability of a 
composite. Armor (1974) suggests several steps that may be 
followed in order to construct a covariance scale or item 
analysis of a composite (see p. 24) . He claims that the 
application of covariance scaling may enhance reliaUbility. 
To some extent, the success of the application may depend 
on subjective judgments more than on analytic criteria. He 
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lists some of the limitations that are inherent in alpha 
reliability and covariance scaling, one of them being that 
alpha depends on the assximption that all items in a 
composite are parallel items, which further implies that 
all the items measure a single underlying scale property 
equally. 

As in the present study, in which the type of 
empirical data that were gathered through categorical 
methodology, the objects or items may measure two or more 
independent properties, for which alpha reliability will 
not be an appropriate measure to use in order to determine 
the internal consistency of the objects and further how 
consistent the sorters agree on these latent partitions or 
dimensions, as commonly Istbeled. Armor goes on to suggest 
a coefficient (theta) similar to alpha which uses factor 
analytic techniques to solve the problem of identifying 
dimensions in a set of data and relating specific items to 
each dimension. He claims that the key to these factor 
analytic techniques, in establishing optimally reliable 
scales, is the formal connection between reliability and 
scaling provided by principal component factor analysis. 
The results of a principal component analysis enables the 
researcher to compute an optimal reliability coefficient. 
Principal component analysis can be use to construct a set 
of factor scores, one set for each factor. A factor score 
is in effect a composite scale score based on a weighted 
sum of the individual items using factor loadings as the 
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weight. Moreover each factor represents a statistically 
Independent source of variation among the set of Items. 
The solution of a component-analysis extracts these factors 
In an order corresponding to the magnitude of their 
variance contribution. In principal component analysis the 
eunount of variance accounted for by a factor Is called V99% 
and Is denoted by Ajc- ^ ^o®^ ^® simply the sum of 

the squared factor loadings for the kth factor. Armor 
(1974) provided the derivation of the theta reliability 
formulas for the case of a single- factor solution and for 
the case of multiple- factor solution. In the present study 
only the formulas will be presented to aid in the 
explanation and use of them. 

For a given set of p items or objects and a single- 
factor solution with rootA.^, the reliability of the 
composite scores based on this factor is given by 

e - cp/(p - (1/Ai)] (9) 

where Ai is the first root of a principal component 
solution (Eentler 1968). Lord (1958) showed that weighting 
items according to their principal -component factor 
loadings theta is the maximum possible alpha. This same 
procedure has been used by Serlin and Kaiser (1978) to 
compute a principal component solution for scoring weights 
for all options in a raultiplci choice test. Willson (1982) 
extended the Serlin and Kaiser procedure by allowing 
several or all options of a given item to be correct. The 
asstimption here is of a single underlying dimension being 
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tapped by the composite. For the situation of 
multiple-factor solution with rotated factors^ Armor (1974) 
gives a modified version of (9) and argues that multiple- 
solution with rotated factors is more complicated. Letting 



tmrotated scores for factor h and the new factor k, and a 
given rotated m-factor solution with original eigenvalues 
•••#Am' ^® reliability of the set of rotated 
factor scnres is given by 



element in the h^ row and k"^ column of the transformation 
matrix that maps the original factor loading into the 
rotated loadings. The formula only holds for orthogonal 
rotations like guartimax or varimax solution. The basic 
interpretation of this coefficient is similar to the one 
given to the alpha coefficient using classical true score 
theory and general iz ability theory which is percentange of 
true score variance by the total score variance. It is 
this procedure and formulation that will be implemented to 
determine how eacl> of the judges agree with each other in 
determining the dimensions of tha set of objects for each 
to the sorting tasks since we are treating the different 
partitions for the total number of objects as a composite. 




be the squared correlation between the original 



^ic* - (P/(P - !))[ 1 




(10) 
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DESIGN OP THE STUDY 

Methodology 

The methodology used for each of the distinct taiiks 
follows the exact procedures developed by Miller, et al. 
(1986) • There are three numerical tasks used to 
illustrate the applicability of categorization methodology. 
The first task is that of the categorization of a set of 
countries. The second numerical example involves the 
sorting of behavior verbs. Finally, a set of statements 
dealing with what it takes for women to succeed is used as 
a final example. The sampled groups performed only two of 
the three task due to time constrains. Both groups 
performed the sorting of countries while the first group 
did the behavior verbs and the second did the personality 
trait statements. The countries sorting task was given as 
a training exercise. 

Description of Samples 

Sample I 

The first sample of sorters consisted of 50 
undergraduate preservice teachers enrolled in an 
educational psychology class. This particular 
undergraduate course was selected on the basis of the type 
of students enrolled in it. This type of sample 
specification is suggested in the categorization 
methodology. The course deals primarily with applica^zion 
of learning theory principles to problems of teaching. Of 
the 50 students selected, 42 declared to be education 
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majors, the rest declared majors ranging from political 
science to theater arts* The sample was composed ol 78% 
females and the mean age for the sample was 21.1 years of 
age. 

Sample II 

The second sample of sorters consisted of 45 
undergraduate preservice teachers enrolled in a similar 
class to the group sample for the first task. The content 
of the course was identical to sample I. Of the 45 
students selected, 42 declared education majors, while two 
declared majors in Scientific Nutrition. The other student 
was in Horticulture. This sample was made up of 76% 
females and the me&t. age for the sample was 20.9 years of 
age. 

Description of Sorting Taslcs 
The Sorting of Countries 

The first task consisted of sorting a random sample of 
30 nations selected from a geography book by James & Webb, 
(1980) : fiofi World Divided . The primary utility of this 
example is to provide proper training and sufficient amount 
of instruction to the sorters, increasing the probability 
that the sortexB or judges understood the task completely. 
Another reason for selecting this task was because of its 
potential for clear category classification. The 
classification of countries into common distinguishable 
categories lends itself to this type of sorting task. (See 
Appendix A for list of selected countries.) 
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The Sorting of Success Statements 

The second sorting task consisted of set of statements 
or items from a self -reporting questionnaire designed to 
measure the attributes needed to achieve personal success 
(see Gardensvarts and Rove, 1987) • The sorting of these 
statements was used to determine the number of different 
categories that judges may derive from a list of 30 Items. 
The main purpose for selecting this task Is to compare how 
the categories created by the sorters differ from the 
categories the authors claim the Instrument seems to 
measure. (See Appendix A for the list of success 
statements • ) 

The Sorting of Behavior Verbs 

The last task consisted of a set of verbs used by 
Miller, Baker, Clasen, Conry, Conry, Pratt, Sheets, Wiley, 
& Wolfe (1967) in their study of teachers* views concerning 
facilitation of leamix«g in the classroom. The main 
objective for using this task is the information it 
provided when it was first carried out by Miller et al. 
(1967). Their study reported the number and types of 
categories that teacher sorters produced for these fifty 
verbs of teachers* behavior in the classroom. This 
reported information has two uses. First, it will be 
useful for comparing the result^ of this study with their 
1967 findings. Second, it will aid in r-eating the modal 
categories needed to make the contingency table for the 
agreement measure. (See Appendix A for list of vnrbs.) 
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SuBimary of Sorting Tasks 

Tha aforementioned tasks ware selected to cover just a 
small section of the vide applicability of categorization 
methodology. Categorization methodology has been applied 
in many research areas, and the selection of these three 
numerical tasks appear to cover some of the more common 
areas in which categorization methodology may be applied. 

Hater ials 

A deck of cards was constructed for each of the tasks. 
One hundred decks of cards were made for the sorting of the 
thirty countries. Fifty deck of cards for both the sorting 
of the 50 verbs and the 30 statements were also 
constructed. The decks of cards were color-coded to 
distinguish them and one thousemd color-coded blank cards 
were also made available to the entire two samples doing 
the sorting task. These blank cards were used by the 
sorter to divide the different categories and to name the 
category they created. The decks of cards were wrapped 
with a rubber band. The same rubber band was used to wrap 
the deck of cards and the dividing blank cards when the 
sorter finished the task. 

Also provided to the sorter was a set of written 
instructions for each of the tasks. Th**^ instructional 
handout was used also to gather demographic information 
about the sorter. 

Procedures 

An instructional handout and a deck of cards were 
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distributed to each of the participants « The researcher 
explained the purpose and the procedure of the task and 
read the instruction to the group. The participants were 
reminded to consult the handout, or ask the researcher, 
should questions arise. The researcher provided help as 
needed. Appendix B contains the three different 
instructional handout forms used in the study. 

The sorters were also provided with a second sat of 
blank color-coded cards vhic> were supposed to be used as 
title cards in the sorting task. There was no time limit 
set to perform each of the tasks. The response rate was 
100 percent. 

When everyone had finished the first task, the sets of 
cards were collected by the researcher, and the second 
instructional handout was distributed to each sorter. 
Similar steps were followed for the administration and 
completion of the second task. Once the sets of sorted 
decks of cards were collected, a data file was created for 
each of the taslcs using a special recording form created by 
the researcher. From this form the computer data file was 
created, and the analyses were performed. 

Analysis of So^^ng Tasks 

The computer data file was created so that each sorter 
had a matrix composed of just ones and zeroes. Thus, for 
the sorting of countries, ninety five rectangular matrices 
were created and readied for analysis. Similar computer 
data files were created for the other two tasks. Appendix 
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C contains a listing of these three data sets. 

Zn order to analyse each data set, a FORTRAN program 
was written so that a joint proportlox^ matrix, S, was 
created and analyzed In that form. Once this matrix was 
created principal-component factor analysis was performed 
on each of the three matrices outputted by the FORTRAN 
program. Three types of rotations were performed for all 
the data sets: guartlmax, varlmax, and obllc[ue. Zn 
addition to using a principal component extraction 
procedure, an alpha factor analysis procedure was performed 
for all tasks. The use of more than one factor analytic 
method and rotation procedure was to make comparisons among 
them. The results reported will be those from the 
principal component solution and the varlmax rotation. 

In order to determine the interrelationships among the 
derived latent categories, the LZSREL VI software was used. 
This program developed by Joreskog and Sorbom (1986) is one 
of the existing programs for estimating covariance 
structures. Wiley's model for latent partition follows 
this type of structure; therefore, the resulting latent 
categories from the latent partition analysis were used to 
specify the model needed to run LISREL. 

To determine the theta irel lability, a SAS program was 
written to obtain theta for each of the sorting tasks. 
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RESULTS 

Latent Gateqories for All Tasks 

The identification of latent structures from 
judgmental data requires the scoring of the sorting of 
objects into stimulus-similarity indices. These indices 
are the probabilities that two given objects or stimuli 
will be included in the same category by a judge. The cell 
entries in the matrix refer to percentage of judges who 
included the two distinct objects in the same manifest 
category regardless of what other items were placed in the 
category. The joint proportion matrices for each of the 
sorting tasks were used as correlation matrices using the 
option in SPSS-X (1987) for reading data in matrix form. 
Latent partition analysis was applied using a factoring 
procedure to the symmetrical joint proportion matrix to 
identify categories from the obtained manifest categories 
for each of the participants in the sorting task. 
Latent Categories for Task I 

Six clusters with eigenvalues over 1.0 were extracted 
from both the alpha factor analysis and the principal 
components analysis from the joint proportion matrix. All 
six clusters were deemed meaningful for further analysis 
but our purpose is to identify not to reduce no subsequent 
analyses were performed. Objects (countries) with the 
highest loadings, all over .5 for a particular cluster were 
retained. Table 1 presents the final rotated cluster 
pattern for this task. Content analysis of the clusters by 
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the researcher yielded the following labels; European 
countries (Fl)« Latin American countries (P2), African 
countries (F3), Unknown countries (F4), Caribbean islands 
(F5), and Northernmost countries (F6). The label for 
cluster four cane priaarily from the leUoels provided by the 
sorters in their manifest categories. As it can be 
observed, the factor loadings were relatively high within 
each cluster and this allowed for easy labeling of the 
clusters. Nevertheless, a criterion of .40 was used to 
determine significant loadings in each category. The only 
coxintry that did not meet this criterion was Morocco (T3). 
The following characteristic roots were obtained for these 
six factors: 6.649, 4.744, 3.992, 3.170, 1.788, 1.743. 
These eigenvalues were used to obtain the respective theta 
reliabilities for each of the factors in .Task I. 
Theta Reliability for Task I 

The factor transformation square matrix which shows 
the correlation between the original un^-otated scores for 
factor h and the new rotated factor k is provided in Table 
2. These values were used to generate theta coefficients 
for each of the clusters produced by the factor analysis. 
This transformation matrix was obtained by using principal- 
component analysis, as recommended by Armor (1974). The 
obtained theta reliabilities for factors one through six 
for this task are provided in Table 3. The column labeled 
Lambda indicated the eigenvalues used for each latent 
partition and the column labeled Theta gives the 
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reliabilities for each of the factors (composites). 
Interrelationship of Latent Categories for Task I 

Teble 4 provides the interrelationships for the latent 
categories found in task I. The oft-diagonal elements of 
these matrices provide an estimate of the probability that 
a random pair of concepts from two different latent 
categories will be sorted into the same observed category. 
These indices sometimes are called confusion indices . The 
diagonal elements provide an estimate of the probeUsility 
that a random pair of elements from the 1th latent category 
is being sorted into the same observed category. These 
indices provide information about the cohesiveness of the 
latent categories. 
Latent Categories for Task II 

The results of the latent categories for this task are 
found in Table 5. Six significemt factors emerged for 
this set of thirty statements. Again, only those factors 
with eigenvalues over one were retained for further 
examination. The table presents the results of a priixcipal 
component analysis and a final varimax rotation cluster for 
the task consisting of thirty statements. Content analysis 
of the individual cltaster, as indicated by the inclusive 
underlined loadings, yield the following general labels: 
£XCUafia (Fl), Magnificent Obsession (F2), Megfl-Anbltion 
(F3), Self-MQi:iv«tQr (F4), Discipline (F5), and Sba£iD9 
with Others (F6). Using .40 as the criteria for 
significant loadings, the six latent categories contain 10, 
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5, 5, 4, 4, and 2 statements on Fl to F6 respectively. 
Some of the labels used here were similar to the ones used 
by the developers of the statements and by the sorters • A 
detailed analysis of this result, indicates that some 
statements appear to be loading high in more than one 
factor. For example, the statement labeled (Til) yielded 
two factor loadings higher than .50 on the factors labeled 
Magnificent Obsefislon and Self -Motivator . Other statements 
yielding high loadings on two factors, although not above 
0.50, were Tl, T3, T4, T13, T21, and T28. 
Theta Reliability for Task II 

Table 6 presents the transformation square matrix for 
this task. The elements of this matrix were used to 
calculate the respective theta coefficients for each of the 
composites. As before, the matrix was obtained by using 
principal component amalysis. The obtained theta 
ro^liabilities are shown in Table 7. As previously noted 
the columns labeled Lambda and Theta indicate the 
eigenvalues and the actual reliability for the composites, 
respectively. 

Interrelationship of Latent Categories for Task II 

As mentioned before, this matrix provides information 
about how the sorters classified each of the statements in 
the proper latent categories (cohesiveness) and also how 
the sorters confused the latent categories. The results 
are shown in Table 8. 
Latent Categories for Task III 
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Eight factors with eigenvalues greater than 1.0 were 
extracted by using principal component analysis on the 
joint proportion matrix for this task. The latent 
categories results are found in table 9. The table 
presents the final varimax rotation cluster for the fifty 
behavior verbs list used for this task. Examination of 
each individual factor yielded the following general 
cluster labels for this analysis. Aspects condueive to 
Learning (Fl) , Aapeeta Detrimenfcal to Learning (F2), 
Aapeets that Reinfo rce Learning (F3), Aspects that make 
Tflaehers Efficient (F4), Aspects that deaJ viiLh Evaluation 
of Learning (F5), Aspects tnat Ensure Learning (F6), 
Supervise (F7), and BsKOEd (F8). The last two factors 
were single item factors. Using .40 as the criteria for 
significant loadings, the six multiple-item factors 
contained 15, 10, 11, 5, 3, and 4 verbs on Fl to F6. As 
observed in the previous two tasks, some of the verbs 
appeared to be loading on more than one factor. For 
example, let us look at the two single-verb factors. It 
is noted that the verb Supervise (T33) has two loading over 
0.40 with one of the loadings in the factor dealing with 
aspects detrimental to learning (F2) and the other high 
loading by itself. Similarly with the verb rewards (T14), 
this verb has two loadings higher than .50. One high 
loading on the factor labeled Aspects Detrimental to 
Learning and the other forming a factor by itself. Other 
verbs yielding factor loadings higher than .40 on more than 
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one factor were reminds (T27), advises (T36), assigns 
(T48), repeats (T23), and reviews (T24) . The underlined 
factor loading scores indicate inclusion of the verbs in 
that column for that particular factor. 
Theta Reliability for Task III 

As before, each of the final solutions yielded a 
transformation matrix which is used to generate the theta 
reliabilities is found in Table 10. The transformation 
matrix for task III produced the interrelations that exist 
between the unrotated factor scores and rotated factor 
scores in the final solution. 

The derived theta reliabilities for the eight factors 
were computed as presented in Table 11. Lambda and Thetu 
columns in the same table are defined as before. 
Interrelationship of Latent Categories for Task III 

Table 13 provides the interrelationship square matrix 
for the eight latent categories obtained from the first 
analysis. The table is shown to indicate the level of 
confusion that the sorters had in sorting the verbs into 
the obtained latent categories and also the level or degree 
of cohesiveness for latent categories obtained. The rather 
small quantities obtained off the main diagonal indicate 
that a small percentage of sorters combined a verb from one 
latent category with a verb from another latent category. 
A diagonal entry from this matrix, as before, refers to a 
single latent category, say (F3), indicates the probability 
that a random pair of items (verbs) from the same latent 
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category Is sorted and put together. 

OISCDSSIOII 
Latent Catogories for Task I 

The results for this task indicate clearly that the 
different clusters of objects appear to represent the 
underlying latent partition for the entire set of objects. 
The sorting of the 30 countries into these categories 
indicate that the latent partition for this task pertained 
to the general latent construct dealing with geographical 
locations. Of the 95 students performing the task, 20 
failed to renain in the same dimension or construct while 
doing the sorting task. In other words, the sorters used 
more than one latent partition to classify or sort the 
countries. The rest of the sorters did remain within one 
latent dimension but this does not mean the selected 
dimension was only locational in nature. 

The factor solution of the joint proportion matrix for 
this task led to the results obtained in Table 1. These 
results clearly showed that expected clustering of the 
individual countries in their respective factors led to the 
appropriate labeling of the resulting clusters or 
categories. There were some countries that contained high 
loadings and loaded on more them one factor. This 
indicates that the object or objects either belong to more 
than one category or the sorters simply perceived that 
object as having more than one common characteristic. For 
example, in the case of the countries forming the Caribbean 
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cQuntirifts factor (F5) one of the countries had a high 
loading on another factor labeled Lat<n Amerir-iin eountries 
(F2). The country (Dominican Republic) could belong also 
to the cluster of countries In the factor labeled Latin 
American countries without any loss of aenbershlp to either 
factor. 

Theta Reliability for Task I 

In order to make use of results from the principal 
component solution for task I, the Information from the 
transformation matrix and the Information gathered from the 
eigenvalues were used to generate the respective theta 
reliabilities for each of the categories in this composite. 
It was observed that the first three factors had the 
highest reliabilities ranging from .66 to .82. These 
factors contained countries that made up continents as 
opposed to the other factors %Aiich did not represent 
commonly known characteristics for those countries. Most 
of the other theta indices were low, particularly the 
factor dealing with Caribbean countries. This factor 
contained only three countries, and its factor loadings 
were not as high as the ones obtained for any of the other 
factors with higher reliability. 

Armor (1974) claims that reliability of a composite can 
be improved by using factor scaling. This involves the use 
of factor scores for composite scales scores instead of the 
traditional unweighted sum of item scores. In other words, 
reliability will be improved when highest-loading items are 
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kept in the factor. The reliability coefficient of the 
first factor in the composite for each of the analyses was 
lover than the secord factor even though the eigen/alue for 
this first factor was the largest and should have yielded a 
larger theta reliability. However, when this first 
eigenvalue divided each of the quadratic terns i^ the 
transforBation aatrix, it yielded a larger tern than 
expected and produced a lover index for the first factor of 
the composite. This is observed in each of the three theta 
analyses for each of the tasks. Once the eigenvalues tend 
gradually to level off for the other factors, the thets 
reliability indices tend to stabilize. Another aspect to 
be considered is that each of these factors vith lov theta 
reliabilities had two or three stimuli per factor. Thus, 
the fever the number of objects or items in a composite the 
lover the reliability index. 

The use of this coefficent (theta) to determine the 
internal consistency for each of the composites appears to 
indicate a more accurate assessment of the consistency that 
each of the objects appear to have for that particular 
factor whenever the case of a composite vith multiple 
factors exists. It appears that if there are more objects 
within each of the factors or partitions, as identified 
here, then the reliability for each of the subscales will 
be improved. 

Interrelationship of Latent Categories for Task I 
In standard latent partition analysis two main 
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natrlces are of Intarest, the phi and omega matrices 
(Wiley, 1967). The matrix that describes the probability 
in which two items are combined is a func on of the latent 
categories to which the object or item belongs, in other 
words, the set of item combination probabilities is 
entirely dependent on a smaller probability set from the 
latent category combination. (Miller et al. 1986). In 
latent partition analysis, these probabilities are 
presented in the omega matrix (Table 4). As previously 
mentioned, the diagonal elements are an index of the degree 
of cohesiveness, and the off -diagonal elements provide an 
index of the degree of confusion among pairs of objects. 
From Table 4, it is clear that there was some confusion in 
some of the latent categories since two of the off -diagonal 
estimates are as large as one of the diagonal estimates. 
The category labeled unknown countries had the largest off- 
diagonal estimate when paired with the latent category 
labeled Africa countries > The probability estimate for 
these two latent categories was 0.437. This result 
indicates that sorting concepts (countries) from two 
different latent categories (Unknown and African countries) 
were not being sorted into the same observed category. The 
same can be stated for the pair of latent categories 
labeled Latin Xmmirinmn countries and Caribbean Islands. 
The probability estimate for this pair was .422. Similar 
argument can be made for these two latent categories. It 
is probable that the sorter will confuse pairs of courtries 
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front these categories since the Caribbean islands can also 
be considered as Latin America countries. The next largest 
estimate for the pair of latent categories labeled £M£fiBfi 
and NorthemmoBii counter ies was .290. Again, similar 
arguments can be stated for the results obtained for this 
pair of latent categories. The rest of the estimates 
indicated relatively little confusion among themselves. 
As indicated above, the diagonal entries 2or the omega 
matrix refer to a single latent category and are the 
probabilities that a given pair of items from that latent 
category will be sorted together. According to Miller et 
al. (1986), when the estimate is high (Miller provides no 
definition of "hic^") the concepts, or objects, and their 
latent category may be considered cohesive . The largest 
estimate in the diagonal was found on the African countries 
latent category. This estimate was .748 emd indicated that 
any pair of countries for that latent category would have 
approximately a 75% chance of being sorted together. 
Miller «t al. (1986) make a cautionary note with respect to 
this cohesiveness concept. They state that a latent 
category need not to be hic^ly cohesive, but it must be 
homogeneous in its pattern of cohesion and confusion (p. 
150). 

Hambleton and Sheehan (1977) state that the average of 
the diagonal elements of the omega matrix may be used to 
reflect em overall agreement about the sorting or 
assignment of concepts into the latent categories. This 
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particular mean for this task was .61. It is worth noting 
that there was no other source in the literature ^ich 
provided more information about the theoretical basis and 
interpretation for this index than the one given by 
Hanbleton &id Sheehan* 
Latent Categories for Task II 

The analysis for this task are found in Table 5. The 
analyses for this data set contains success statements 
which yielded six latent categories for the 30 statement 
sorted by 45 students* The developers of these statements 
claimed that there are five major categories each with six 
statements • The appendix contains the actual subset of 
statements comprising each of thft major categories as 
suggested by the researchers* In the present study, six 
major clusters or latent categories were identified by the 
principal component analysis. As clearly seen from Table 
5, most of the statements within each latent category had 
very high loadings but it was also observed that some of 
these statements had high loadings in more than one latent 
category* This indicates certain degree of ambiguity for 
that statement as it was perceived by the sorters* A 
closer look at these statements and their respective latent 
category appears to indicate that the categories themselves 
were not totally unrelated* For example, consider the pair 
of latent categories labeled Discipline and Self-Motiivator^ 
There are four statements with high loadings in the 
Discipline cluster, and there were four in the Self* 
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Motivator cluster. Of these eight itatements, there were 
four statenents that showed moderate to high loadings in 
both latent categories. 

Similar observations can be made for other pairs of 
latent categories as presented on Table 5. This 
overlapping seems to indicate that there are probably fewer 
than six distinct latent categories un'^erlying this set of 
30 statements. 

Theta Reliability for Task II 

In order to compute the theta rfiliability lor this 
task, the results from the principal component solution 
were used to obtaii tli^ specific reliability index for each 
of the resulting latent categories. Specifically the 
factor transformation matrix and Uie eigenvalues for each 
of the latent categories as provided by the computed factor 
analysis . suits. Theta reliedsility computations were 
performed for both solutions. For the six latent category 
solution, the first two latent categories had the highest 
theta reliabilities. As was observed in the results in 
task I, the second latent category was larger in magnitude 
than the first latent cateqory. The first latent category 
contained statements that pertained to negative or 
detrimental attributes and aspects while the second latent 
category contained statements thac dealt with positive or 
desirable attributes and characteristics. These three 
latent categories by themselves accounted for 56 percent of 
the variance. 
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The next highest latent category was the one dealing 
with statements with connotations toward ambitious goals 
and dreams In order to achieve success. The rest of the 
theta reliabilities decreased In magnitude and the apparent 
reason for their low reliability Index Is attributed that 
each of these latent categories did not contain enough 
statements to form a true latent category. 
Interrelationship of Latent Categories for Task II 

As previously described, latent partition analysis 
generates two matrices which describe the sorting behavior 
of the r — *:ers In a free categorization task. For task 
two, the omega matrix Is presented In Table 8. The 
results of this analysis show that there was some confusion 
In several latent categories. The largest off**dlagonal 
probability estimate was found with the pair of latent 
categories labeled Discipline and self ^Motivator , This 
probability estimate was 0.471 and Indlcatefn that pair of 
concepts from the two latent categories were not being 
categorized into the same observed or manifest category. 
Similar explanations can be made for the combination of 
latent categories labeled Hfl?^"Ambit1s?n and Self -Motivator , 
It appears that sorters had more difficulty in sorting the 
statements which dealt with positive attributes than in 
sorting the concepts pertaining to negative statements from 
the latent category labeled Excuses > Notice the first 
column (Fl) o^ the omega matrix, all the off-diagoiial 
estimates were very low~jieanlng very little confusion 
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among these type of statements. It is also observed that 
the first diagonal element in the matrix was the largest in 
relation to the rest of the diagonal probability estimates. 

The main diagonal estimates for this task indicate 
:.hat the latent categories do not seem to be highly 
cohesive among themselves. The a/orage category 
cohesiveness value was .58, which is not very high in terns 
of the ovetall agreement that may have existed among the 
sorters. 

Latent Categories for Task III 

The results for the sorting task dealing with the 
teacher behaviors were presented in Table 9. Eight latent 
categories were extracted by the principal component 
procedure. This set of verbs depicting teachers' behaviors 
were the same employed in the original study by Miller et. 
al (1967). This very study led to the development of the 
categorization methodology which is composed of the F-sort 
technique and the latent partition technique. The primary 
use of this set of verbs was co make comparisons with the 
results obtained by the Miller et al. (1967) study. Their 
original study produced ten different latent categories for 
the set of verbs. The results of the study show that the 
there were two types of categorizations created by vhe 
sorters. According to Miller et al., the substance and 
structure of the categories suggest that the sorters 
grouped the set of verbs from different points of view. 
One of the types of categories created showed finer 
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discrininations while the other category type reflects more 
evaluative ideas. They claimed that these two types of 
categorizations clearly portray che kinds of different 
perceptions that can be observed by the F-sort procedure. 

The results for the present study showed six clearly 
identifiable clusters and two single It^ (verb) factors. 
These results seem tp natch the Miller experimental results 
primarily in the second type of categorization %rtiich dealt 
with aspects desirable and undesirable in teaching. It 
should be mentioned that the sample of sorters used in the 
original study was isubstantially larger than the sample 
size selected for tl«e present study. Additionally, the 
original study selected both teachers and preservice 
t^ichers while in this study only preservice teachers were 
Selected for the sortiitg task. 

It ip interb(5ting to note that clustering of the 
indivi<^ual verbs was very similar to those of the original 
study even though the sample size for the present study was 
relatively small when compared with the sample size of the 
original study. This seems to indicate that in order to 
establish categories of this type there is no need for 
sample pizes as large as the one used by Miller et al. 
(1967) since the results will not b^ that drastically 
different from each other. This may also reduce \the 
probability that undetected subgroups within the sorter 
sample say perceive the same set of concepts in a different 
way yielding larger number of latent categories, whic i in 
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turn nay be difficult to describe and explain. . 
Theta Reliability for Task ZIZ 

The theta reliabilities for the present task ver^ 
reported in Table 11* The results for this analysis shoved 
that the ^eta indices ranged fros .30 to .BB* Similar 
behavior was observed for the first and second latent 
categories. The first category, as previous tasks, yielded 
a saaller index as compared to the second latent category. 
The first five latent categories had reliabilities that 
were high in relation to the last tliree categories 
indicating the plausibility of an alternative nodel with a 
smaller number of latent categories explaining the same set 
of verbs. It is noted that both single verb categories had 
a higher theta reliability them the latent category dealing 
with aspects of teaching that ensure learning. This is 
explained by the high degree of ambiguity of the verbs 
belonging to this category. 

Interrelationship of Latent Categories for Task III 

The results of the interrelationships that exist among 
the latent categories were presented on Table 12. The 
results of the omega matrix were those from the eight 
factor solution. The ol ^diagonal elements in the matrix 
indicate relative amount of confut^ion for this set of 
latent categories. The largest off -diagonal probability 
estimate was .425, while the smallest probability estimate 
was .106. This large probability estimate indicates that 
pairs of concepts (verbs) from the latent categories 
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labeled Aspacta conduct va t:e Learning and Aspects that 
Enaure T^arniny were being Sorted 43% of time. That is, a 
large nuaber of of sorters did not differentiate the verbt; 
of the two categories; therefore, verbs froa the Aspects 
Conducive to Learning category were being conbined with 
verbs fron the category of Aspects that Ensure Learning. 
This shows that these two latent categories aay not be 
entirely different from each other. The diagonal entries 
froa this aatrix shows low probability estiaates for this 
set of latent categories. The largest values observed was 
1.0 for the two categories with just one concept. These 
results were expected and are considered aeaningless since 
it is desired that at least two concepts with coanon 
characteristics be sorted together. The largest estimate 
in this group was obtained for the latent category dealing 
with Aspects th at make a Teacher wore Efficient in the 
facilitation of learning. This index (.833) indicates that 
a given pair of iteas froa that latent category had an 83% 
chance of being sorted together. The rest of the estiaates 
were moderate iaplying moderate levels of cohesiveness . 

samoMS 

The central focus of this research was to illustrate 
the applicability of categorization methodology and to draw 
implications regarding the use of such methods developed 
and employed in other related fields and testing 
situations. The inclusion of the theta reliability index 
was considered of major importance to the enhancement of 

erJc ^6 
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the existing and useful nethodology of categorization 
developed by Miller et al. (1967). The selection of the 
three sorting tasks was based on the decision to eaploy 
different situations in which categorization methodology 
has been applied and nay be applied by researchers. These 
three tasks were used to illustrate the use of these 
measures that were adapted for use in this methodology. 

The use of theta reliability procedures in latent 
partition analysis appears to be justified given the nature 
of the tasks usually involved in this methodology. This 
methodology calls for the creation of more than one 
category for a given set of stimuli, therefore, 
conventional reliability procedures may not be applied to 
this type of multiple-category solutions as found in latent 
partition analysis. The indices of thets reliability for 
each of the illustrations provided an insight on how the 
stimuli in each partition were actually related to the 
latent category. This proposed index is endorsed in the 
present study as a means for the determination of the 
internal consistency of the subscales or subcategories that 
are derived from the latent partition analysis. This 
measure should be used to reflect the degree by which many 
sorters consistently sort sets of particular it^ms into 
manifest categories. Due to the lack of existing measures 
such as theta, it is proposed that theta reliability 
analysis should be an integral part of the categorization 
methodology. The addition of this measure should only 

ERIC 47 
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enhance the utility of this categorization nethodology, 
regardless of the testing situation. 

While the results of this study denonstrated the 
usefulness of categorization aethodology by using factor 
analysis techniques, it became apparent that Araor's theta 
reliability coeffiecient gi^atly enhanced the present 
nethodology. Hbwever, the coefficient requires further 
theoretical research. This research can be focused ir 
detemining theoretical distributional properties to 
determine significance and upper or lover confidence lisits 
for saiQ>l<3 statistics. This may be done through the use of 
Monte Carlo simulation studies. Additional studies can be 
geared toward determining differences between the empirical 
results obtained when methods other than principal 
component analyses are employed to determine the 
eigenvalues, irtiich are used to calculate theta. 
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TABLE 1 

Latent factor structura for task I: six factor solution 



Nana 

of Fl F2 F3 F4 F5 F6 

Stimulus 



Belgium .87798 .02379 .07483 .04888 .05782 .08099 
Czechos- 

lovaquia .87667 .01773 .01717 -.03355 .05225 .04590 

Luxembourg .^AfiZifl -.01947 .00410 .14794 .16138 -.08395 

Romania ,t32Sl± .07213 .11101 .04087 .10073 -.00670 

Denmark .aU2£2 .02473 .05064 .03524 - ^^4709 .34663 

Spain .80447 .20500 .07407 .00678 -.01666 .01444 

Greece .^AfiSfil .11696 .05103 .00070 -.03538 .06654 
Liechten- 



stcii. 


.79347 


-.03288 


-.01192 


.25770 


.15409 


-.06504 


Finland 


.78619 


.03271 


. 07585 


.04658 


-.08622 


.36540 


Peru 


.08901 




.07538 


. 06598 


-.03162 


.01181 


Brazil 


.08871 


.84995 


. 06156 


.03949 


-.00889 


.02958 


Panama 


.01498 


. 07425 


.07445 


.20507 


.13169 


Guatemala 


.04397 




. 05254 


. 05758 


.25137 


.05669 


Paraguay 


.10802 


.76471 


,192C5 


.15858 


.10468 


-.06228 


Mexico 


.00028 


.64600 


. 03848 


. 03562 


.20428 


.43499 


Ziaibabwe 


.06445 


.08977 




. 136C2 


. oeii9 


.05204 


Nigeria 


.06430 


.09692 


.88817 


. 19731 


. 07088 


.00120 


Niger 


.06362 


.15263 


.20296 


.00528 


.03145 


Rwanda 


.04668 


.03188 


.«57<2 


.577« 


.02746 


.01713 


Tanzania 


.01309 


.03093 


.65716 
.46702 


.57819 


.C6777 


.01081 


Morocco 


.27492 


. 14715 


.22960 


.28777 


-.07346 


Mauritania 


.02221 


.12252 


. 15994 


.79236 


.20107 


.01112 


Ser^gal 


.06889 


.09197 


.23359 


.75552 


. 17572 


.05121 


C^r?roon 


.01106 


. 04100 


.41178 


.71943 


.19374 


.08953 


Nepal 


.33420 


. 13560 


.16088 


.61995 


-.13896 


-.00666 


Barbados 


.1126 


.36414 


.02455 


. 16925 




. 12702 


Trinidad 












Tobago 


.09339 


.17347 


.25038 


.26839 


.65628 


-.01237 


Dominican 












Republic 


.04204 


.57727 


.03215 


.03023 


.58730 


.15747 


Canada 


.06243 


.22708 


-.00446 


.04139 


.08526 


.92^4? 


Tceland 


^4J[m 


.02561 


. 04908 


.05455 


.G3569 


.71125 



Note. The underlined factor loadings for each factor 
indicate the membership of the objects to that factor. 



Fl » European countries P2 - Latin American countries 

F3 - African countries F4 - Unknown countries 

F5 - Caribbean Islands F6 - Northern countries 
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TABLE 2 

Transformation matrix for task I: six factor solution 



Factors 



Fl 



F2 



F3 



F4 



F5 



F6 



Fl 
F2 
F3 
F4 
F5 
F6 



.63831 
.75279 
.02628 
.02835 
.15579 
.00971 



.43224 

.38899 
.72755 
.18242 
..'1265 
.23244 



.41716 
.39343 
-.51447 
-.58023 
.01692 
-.26373 



,38186 
,30000 
,38934 
,59288 
,04102 
,50932 



.23543 
.18459 
.14399 
.52348 
.00205 
-.78469 



. 17450 
-.05593 

.18161 
-.06101 

.96361 

.03434 



Not«. ThB elements of this matrix were used to calculate 
the respective theta coefficient for each of the categories 
in task I 



Fl *■ European countries 

F2 « Latin American countries 

F3 " African countries 

F4 - Unknown countries 

F5 " Caribbean countries 

F6 - Northernmost countries 



TABLE 3 

Theta reliabilities for task I: Six factor solution 





Latent partition 


Lambda 


Theta 


1. 


European cotmtries 


6.649 


.788 


2. 


Latin American c. 


4.744 


.822 


3. 


African countries 


3.992 


.769 


4. 


Unkno%m countries 


3.170 


.664 


5. 


Caribbean countries 


1.788 


.469 


6. 


Northernmost countries 


1.743 


.563 



Note. Lambda indicates the eigenvalues obtained after the 
rotation. 
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TABLE 4 

Interrelatlonshlpa of th« latent categories 
for task Z: Six factor solution 



Latent category Pi P2 F3 F4 P5 F6 



FX 0 682 

F2 0.108 0.669 

F3 0.122 0.177 0.748 

F4 0.136 0.169 0.437 0.553 

F5 0.131 0.422 0.195 0.261 0.5^3 

F6 0.290 0.186 0.079 0.107 0.184 0.459 



Fl ■ European countries 

F2 - Latin American countries 

Pi ■ African countries 

F4 - unlcnoim countr'*es 

F5 - Carlbbear. Islands 

F6 - Northernmost countries 
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TABLE 5 

Latent factor atructura for task II: Six factor solution 



Nans 



of 


Fl 


F2 


F3 


F4 


F5 


F6 


stimulus 












T2 


.94865 
.91441 


-.00259 


-.01516 


.02112 


-.02633 


-.02893 


T18 


.01109 


-.03264 


.05537 


-.03071 


-.03418 


T24 


.89777 


.04245 


-.00808 


.05914 


-.01198 


-.01666 


T22 


.00457 


.03383 


-.00140 


.02003 


-.01837 


T14 




.02xy6 


-.00873 


.04767 


.01037 


.02336 


T20 


.80842 


.13532 


-.01708 


.03502 


.06083 


-.02755 


T9 


.79»5 


.18114 


.09821 


-.01444 


-.01619 


-.02108 


T29 


.78335 


-.01010 


.08163 


-.03326 


-.05113 


.22426 


T16 


.68489 


-.05291 


.08693 


-.11902 


.26466 


.15959 


T26 


.52981 


.36421 


-.00475 


.09650 


.18625 


.90462 


T8 


.07404 


.89893 


. 18868 


.010C9 


.10921 


.12797 


T23 


.02870 


.78500 
t72«09 


.39047 


.11918 


.04057 


-.02567 


T3 


.01956 




. 14701 


.04839 


.04435 


T27 


.16306 


.69720 


.05960 


.20898 


.09237 


.18160 


Til 


.04635 


.5»78 


-.00648 


.90730 


.03249 


.29826 


T17 


.00837 


.15056 


.79736 


.34896 


.12087 


.03492 


T6 


.01325 


.09907 


.77362 


.25071 


.22467 


.04554 


T19 


.00836 


.30705 


.08812 


.08578 


.13950 


T28 


.01494 


.46412 

.49328 




.29700 


.03153 


-.04429 


T13 


.16309 




-.10118 


.07553 


-.07717 


T7 


-.00242 


.21716 


.35889 


.7$119 


.16955 


.04301 


Tl 


.00175 


.10689 


.17983 


.73062 


.42269 


.15686 


T12 


.05068 


.23734 


. 19754 


.70929 


.33017 


-.00254 


T4 


.05202 


-.04932 


.41934 


.55475 


.22390 


.32576 


TIO 


.07137 


.08330 


.06488 


.08735 


.820^7 


. 16384 


T25 


.05655 


.02348 


.14728 


.25628 




.07566 


T21 


-.00261 


.24633 


. 10063 




.64455 
.55470 


.04413 


T5 


.01867 


.05019 


.31288 


.39650 


.15879 


T15 


.05764 


.34006 


.00890 


.16870 


. 0f>036 


.82728 


T30 


.0531p 


.04193 


.11676 


. 1180? 


.3>«096 


.80323 



Note. The complete description of the stimulus name is 
provided in appendix B. The underlined factor loadings 
indicate membership of object to that factor. 

Fl ■ Excuses 

F2 • Magnificent obsession 

F3 ■ Mega-ambition 

F4 ■ Self-motivator 

F5 • Discipline 

F6 - Sharing wi*^h ethers 
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TABLE 6 



Transformation matrix for task II: Six factor solution 



Factors 


Fl 


F2 


F3 


F4 


F5 


F6 


Fl 


.48072 


. 47017 


.45109 


.42366 


.35079 


.20451 


F2 


.87246 


-.18279 


-.28117 


-.28395 


-.19506 


-.08596 


F3 


.04327 


61892 


-.29048 


.33019 


.59940 


.24977 


F4 


-.06788 


.48247 


-.61751 


-.09858 


.00413 


.60956 


F5 


.00361 


-.31896 


.49587 


-.3679-; 


-.17701 


.69688 


F6 


-.03505 


.16720 


. 07670 


-.69696 


.66953 


-.17579 



Note. The alements of this matrix were used to calculate 
tlie respective theta coefficient for each of the categories 
in task ZZ« 



Fl • Excuses 

F2 ■ Itognificent obsession 

F3 ■ Mega-Ambition 

F4 ■ Self-notivator 

F5 • Discipline 

F6 - Sharing with others 



TABLE 7 

Theta reliabilities for task ZZ: Six factor solution 





Latent partition 


Laobda 


Theta 


1. 


Excuser 


6.839 


.744 


2. 


Magnificent obsession 


3.683 


.840 


3. 


Mega-anbition 


3.404 


.693 


4. 


Self-motivator 


3.064 


.632 


5. 


Discipline 


2.756 


.590 


6. 


Sharing with others 


1.772 


.674 



Note. Lambda indicates the eigenvalues obtained after the 
rotation . 
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TABLE 8 

Zntexxelatlonshlps of th^ latant categorlM 
for task IZ: Six factor solution 



Latent category 


Fl 


F2 


P3 


F4 


P5 


F6 


Fl 


0.737 












F2 


0.087 


0.606 










F3 


0.050 


0.428 


0.577 








F4 


0.042 


0.320 


0.408 


0.624 






F5 


0.052 


0.220 


0.283 


0.471 


0.547 




F6 


0.066 


0.257 


0.177 


0.301 


0.303 


0.620 



Fl - Excuses F2 - Magnificent obsession 

F3 - Mega-ambitioii F4 « Self -motivator 

F5 - Discipline F6 « Sharing with others 
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TABLE 9 

Lat«nt factor structurs for task III: Eight factor solution 



Haaa 



Of 

itiaulut 


n 


fZ 


F3 


F4 




F6 




F7 


F8 


Cltrlfltt 


.S6816 


.01043 


.18232 


.06711 


.09432 


.01565 




.12334 


.04921 


Sfaplff f ft 




.02618 


.15323 


.11639 


-.00570 


.05455 


• 


.07257 


.05058 


Explaf nt 


.S24AA 


.00173 


.18268 


.07704 


.05640 


.16856 




.18605 


- .02774 






.00695 


.22097 


.06126 


-.01394 


.20239 




.14826 


- .12410 






.03198 


.14529 


.23045 


-.01479 


.23807 


• 


.26099 


.18247 


Intorprttt 




.03619 


.19377 


.10357 


.20077 


- .03526 




.14055 


- .07663 


introducts 


.77389 


.05947 


.11035 


.20797 


.11310 


.10964 




.08458 


- .02482 


DtBonstratot 




.03302 


.08939 


.24500 


-.00030 


.26089 


- 


.18874 


.22169 




tTmt 


.02555 


.31S79 


.08024 


.11694 


-.01394 




.10913 


- .20033 




.71?11 


.02360 


.10358 


.04944 


.30046 


.23264 




.05484 


- .02311 


Displays 


.6S6A0 


.02632 


.18464 


.34214 


-.04961 


.17426 


- 


.25448 


.28957 


ExtapMf Us 


.54769 


.09780 


.33376 


.15454 


.00507 


.21215 




.05672 


.03636 


Lscturss 




.18996 


.09012 


.12632 


.11299 


.36739 




.00351 


-.39104 


Qusst f ens 


.47239 


.03856 


.19797 


.10664 


.31529 


.35678 




.18495 


.10643 


RsBlnds 


JiU9Z 


.07351 


.40255 


.10612 


-.03942 


.35911 




.24887 


.06810 


Thrsstsns 


-.01111 


.93868 


.05386 


-.00816 


.00687 


.06401 




.10031 


.00109 


Rsstrfcts 


.01035 


.91542 


•06103 


.03454 


.04462 


.01695 




.01391 


- .03442 


Rsprlasnds 


-.01536 


.90482 


.02796 


.03149 


.02314 


.07491 




.04720 


- .00309 


tsnsl f Its 


.01770 


.89S24 


.06783 


.02697 


.09017 


.03225 




.07268 


.06288 


Controls 


03092 


.81990 


.05354 


.17622 


.06853 


.06360 




.27381 


.00842 


Enf orcss 


.09077 


.81815 


.05744 


.09304 


.06625 


.03525 




.22319 


.12329 


Dsnsnds 


.04060 


.77432 


.19391 


-.03835 


.05070 


.05007 




.13658 


- .06768 




.08290 


.79032 


.07403 


. 1 7672 


.03869 


- .00453 




.30481 


.01955 


Judfst 


.04133 


.59003 


.12677 


.00884 


.35127 


.05362 




.15997 


- .08500 


Psrsif ts 


.03664 


.42279 


.36964 


.184e9 


.06651 


.13762 




.30021 


.12815 



Votm. The undarllned factor loading for each factor 
indicate tha mexnbership of the objects to that factor. 

Fl - Aspects conducive to learning 

F2 - Aspects detrimental to learning 

F3 - Aspects that reinforce learning 

F4 ■ Aspects that make teachers efficient 

F5 - Aspects thi^t deal with evaluation of learning 

F6 ■ Aspects that ensure learning 

F7 ■ Supervise 

F8 » Reward 
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TABLE 9 
(Continued) 



Of 


n 




F3 


F4 


F5 


F6 


¥7 


n 




•17326 


•03812 


.86131 


•11370 


•01817 


•04449 


•06409 


•15600 


Inspirit 


•19370 


•03660 




•10256 


•02103 


•07343 


•03014 


•19287 




•24825 


•04297 




•09953 


•03632 


•01685 


••0-^172 


•15621 




•24484 


•068Sf 


.82798 


.07329 


•05873 


••01438 


••00411 


••21442 




•16930 


•11658 


.81337 


•04339 


••01200 


•10133 


••01527 


••11762 


I apt Is 


•00421 


.38478 


.69869 


• ^04178 


.00215 


•10422 


••07942 


••08009 


CoMonds 


•16947 


•10346 




•03538 


•20743 


• ^02074 


•11176 


•43285 




•36769 


•07477 


.64790 


•04206 


•10300 


•02128 


••00738 


••35742 


Advlsts 


•30995 


•04238 


.55371 


•10035 


•*0613 


•10741 


•40134 


••06799 


Cenf Iras 


•38306 


•05526 




•^•01240 


•33075 


•08806 


•33799 


•13514 


R«lnforc«s 


•32786 


•16007 


.41859 


••0317b 


•03704 


•36966 


•21599 


•15347 


Plsns 


•18593 


•09700 


.08464 




•16395 


•04833 


•05872 


••02476 


Or9«n1i«s 


•21672 


•04390 


•10256 




•10315 


•09538 


•06135 


•02125 


Arrsnsss 


•25798 


•07855 


•12410 


.««127 


•05498 


.04631 


•02563 


•04498 


$chsdul«s 


•16316 


•14371 


.04098 


.84265 


•21972 


•09048 


••04485 


•01389 


Assigns 


•19642 


•1S557 


•06431 


.447?? 


•32685 


.42457 


•18109 


••12260 


Grsdss 


•05362 


•19525 


•04034 


•23674 


.83876 


•16617 


•00480 


•03665 


Evslu«t«s 


•22729 


•08423 


•14496 


•13246 


.80586 


•01889 


•18492 


•04889 


T«sts 


•14566 


•16329 


•03208 


•22727 


.77551 


•26541 


••11489 


•02230 


Drills 


•25696 


•27785 


•00328 


•04163 


•24509 


.66899 


••14408 


••09932 


Rspssts 


•52951 


•09380 


.08267 


•03591 


•08382 


.60297 


•11921 


••04126 


RSVlSMS 


•47621 


.00065 


.07315 


•14058 


•21759 


.??1«? 


•03628 


•12640 


Tutors 


.31660 


••02307 


•19730 


•26801 


•09816 


.50569 


•14393 


•04947 


Suporvisos 


•26541 


.41603 


•17857 


•30609 


•00171 


•19576 




•00354 


RoMords 


• 153lr2 


. 15790 


.50193 


•09149 


.27583 


•C7174 


•01362 





Not*. Tb« underlined factor loadings for each factor, 
indicate the menbership of the objects to that factor 

Fl ■ Aspects that are conducive to learning 

F2 - Aspects that are detrimental to leamii j 

F3 - Aspects that reinforce learning 

F4 - Aspects that make teachers efficient 

F5 m Aspects that deal with evaluatio \ of ^earning 

F6 - A£;pects that ensure learning 

F7 ■ Supervise 

F8 ■ Reward 
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TA'^LB 10 

Transformation nat^rix for ta£k III: Eight factor solution 



Paetert 



n 



PS 



P4 



PS 



P6 



P7 



P8 



PI 
P2 
PS 
P4 
PS 
P6 
P7 
P8 



.66S71 
.422SS 
.210S6 
.47210 
.1S807 
.04022 
.S006S 
.0100S 



,S0S41 
.90096 
.08S99 
.2S694 
.1201S 
.06096 
.06707 
.0t198 



.47782 
.OOSSO 
.821S8 
.246S4 
.0126S 
.00916 
.10489 
.1S8S1 



.S007S 
.001S8 
.40497 
.7098S 
.47999 
.002S1 
.0SSS4 
.09067 



.22964 
.0798S 
.22304 
.SS176 
.80S47 
-.04981 
-.S41S4 
.11SSS 



.28410 
-.04209 
.22S6S 
-.10006 
.29187 
.02782 
.86679 
-.14217 



.1012S 
.0S897 
.0644S 
.0S904 
.028S8 
.7S718 
.07777 
.6S278 



.048S1 
.00498 
.07602 
.1S166 
.0S428 
.646S2 
.1S09S 
.72976 



Nota. Ths alsBants of this matrix vara usad to calculata 
tha raspactiva thata coaf ficiant for each of tha categorias 
in task III. 

PI ■ Aspacts conducive to learning 

P2 ■ Aspects detrimental to learning 

P3 ■ Aspacts that reinforce learning 

P4 ■ Aspects that make teachers more efficient 

F5 ■ Aspects that deal with evaluation of learning 

P6 ■ Aspects that ensure learning 

F7 - Supervise F8 - Rewards 

TABLE 11 

Theta reliabilities for task III: Eight factor solution 



Latent Partition Lambda Theta 



1. 


Conduciva to learning 


9.395 


.845 


2. 


Detrimental to learning 


7.154 


.881 


3. 


Reinforce learning 


6.828 


.830 


4. 


Teacher efficiency 


4.144 


.792 


5. 


Evaluation of learning 


2.969 


.703 


6. 


Ensure learning 


2.713 


.301 


7. 


Supervises 


1.463 


.668 


8. 


Rewards 


1.343 


.319 



Note. Lambda indicates the eigenvalues obtained after 
rotation. 



TABLE 12 

Znt«rrttlatlonshlps of lat«nt cate^oriM 
for task ZZZ: Eight factor solution 

Lattnt cattfory F1 F2 FS F4 FS F6 F7 FS 



Fl ■ Aspects conducive to learning 

F2 Aspects detrimental to learning 

F3 ■ Aspects that reinforce learning 

F4 - Aspects that make teachers efficient 

F5 > Aspects that deal with evaluation of learning 

F6 - Aspects that ensure learning 

F7 - Supervise F8 - Reward 



Note. The element or (j«l) for these matrices 

provides an estimate of the probability that pairs of 
concepts randomly drawn from two different latent 
categories will be sorted Into the same observed category. 
The diagonal elements, (1#1), provide em estimate of that 
probability of pairs of stimuli randomly drawn from the 1th 
latent category being sorted into the same observed 
category. 



PI 
rz 

PS 
P4 
PS 

p« 

P7 
Pt 



o.sss 

0.106 0.«1« 

0.S2S 0.18S 0.480 

0.S06 o.us 0.210 o.ass 

0.240 0.21S 0.209 0.S28 0.720 

0.42S O.Ut 0.2S0 0.27S 0.S1S 0.477 

0.S29 0.400 0.298 O.SSS 0.240 0.29S 1.000 

0.268 0.220 0.41S 0.22S 0.S20 0.2S0 0.260 1.000 
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APFSNDZZ A 
STZHDLZ DESCRIPTZOM NAME FOR S01ITI1I6 TASKS 
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ERIC 
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D«scription of stlBUlus nana for task I 

lAST OP OODIITRIBS 



Tl. 


TANZANIA 


T2. 


RWANDA 


T3. 


MORROCO 


T4. 


CAMEROON 


T5. 


MAURITANIA 


T6. 


NIGER 


T7. 


NIGERIA 


T8. 


ZIMBABWE 


T9. 


SENEGAL 


TIG. 


NEPAL 


Til. 


DOMINICAN REPUBLIC 


T12. 


BARBADOS 


T13. 


TRINIDAD TOBAGO 


T14. 


CZECHOSLOVAQUIA 


T15. 


GREECE 


Tlfi. 


DENMARK 


T17. 


BELGIUM 


T18. 


LUXEMBOURG 


T19. 


ROMANIA 


720. 


SPAIN 


T21. 


LIECHTENSTEIN 


T22. 


FINLAND 


T23. 


ICELAND 


T24. 


CANADA 


T25. 


MEXICO 


T26. 


BRAZIL 


T27. 


PANAK/i 


T28. 


GUATEMALA 


T29. 


PERl< 


T-0. 


PARAGUAY 



6V 

o 

ERIC 



Description of stljiuluft aaam for task IZI 



MILUR BT AL. LIST OP VERBS 



DBNONSTRATBS 


ILLUSTRATES 


DISPLAYS 


THREATENS 


PENALISES 


REPRIMANDS 




RESTRICTS 


IMPBLS 


INSPIRES 


ENOOORAtfES 


COMMENDS 


SmnJLATBS 


REWARCS 


GRADES 


TESTS 


EVALUATES 


JUDGES 


PLANS 


ORGANIZES 


ARRANGES 


SCHEDULES 


REPEATS 


REVIEWS 


DRILLS 


REINFORCES 


REHmOS 


PERSUADES 


CONVINCES 


URGES 


REGULATES 


CONTROLS 


SUPERVISES 


PERMITS 


ENFORCES 


AOVISBS 


CLARIFIES 


SIMPLIFIES 


INTERPRETS 


EXPLAINS 


REASONS 


CONFIRMS 


ANSWERS 


EXEMPLIFIES 


X2CTURES 


DISCUSSES 


QUESTIONS 


ASSIGNS 


INTRODUCES 


TUTORS 



Description o^' vtiaulus naa* for task ZI 

GARDENSIIARTZ AND 80IIB LIST OF STilTEKENTS 

1 am snergetic and anthusiastic about ay life and 
vork. 

T2. Z avoid new situations and challenges. 

T3. Z vant to rank with the greats in ay f.^eld. 

T4. Z accept the consequences of ay choices. 

T5. Z parlay each of ay experiences into aany 
opportunities. 

T6. The goals Z aa iapleaenting are ay own. 

T7. Z aa a self-starter, and Z*a quick to take action when 
Z know what Z vant. 

T8. Z like to be a big fish in a big pond. 

T9. Hy "wishbone" is stronger than by "backbone." 

TlO. Reading is a priority for ae. 

Til. Z e^^ect perforaancr to be top-notch -both mine 
and others*. 

T12. z coaait no-holds-barred energy to tasks that are 
iaportant to me. 

T13. My goals and dreaas are whale size. 

T14. z aa reluctant to continue when I*a told it can't be 
done. 

TIS. Z present ideas so that people see what's in it for 
thea. 

T16. Zt's iaportant to me to work no more than aours 
a week. 

T17. Z continue to set challengi^ig goals for myself. 
T18. The feeling that "Z can't" inflaences my behavior. 
T19. Each J rson creates his or her own destiny. 
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Dtseription of 0ti»ulu0 nammm for task ZZ 

T20. Z riisist new ideas ones Z*va nada up ay nind. 

T21. Work la a aourca of joy to aa. 

T22. Z lat things fall through tha cracks. 

T23. Zt*s important to na to naka ny mark in tha world. 

T24. Discriaination about vcman holds na hack. 

T25« Z an coafortabla daaling with budgetary and financial 
mat tars. 

T26. I gat angrossad in my work and forgat thara^s a world 
outsida. 

T27. Z am happiest idim Z*m in charge. 

T28. Hy motto is, "The &ky«s the limit." 

T29. My responsibilities to others keep w from working on 
my own goals. 

T30. Z have a cadre of people I can count on for help 
and support. 
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APPENDIX B 
INSTRDCTZOK FORMS POR SORTING ThSTS 



ERIC 
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ZMSTRDCnONS 

THE SORTING OP CODMTRZBS INTO CATBGORIBtf 

PORPOSE: THE OBJBCTIVZ OF THE TASK IS TO CREATE CATEGORIES 
(PILES) WHICH DESCRIBE THE COOMTRISS BT A COMMON 
FBATDRB OR CHARACTERISTICS. 

TASK DESCRIPTION: 

1. START WITH THE FIRST COUNTRY CARD. 

2. USE THE CARD TO START YOOR FIRST CATEGORY. 

3. PICK UP THE NEXT COUNTRY CARD. 

4. DECIDE WHETHER THIS COUNTRY CAN BE GROUPED WITH 
THE FREVIOOS ONB: 

IF YES, THEN POT THE CARD IN THAT CATEGORY GROUP 
IF NOT, THEN CARD TO CREATE A NEW CATEGORY GROUP 

5. PICK UP THE NEXT CARD AND REPEAT THE PROCESS. 
IF YOU ARB OUT OF CARDS: 

1. DECIDE WHETHER YOtH CATEGORIES ARE A SATISFACIORY 
REPRESENTATION OF YOUR SORTING. 

2. IF NOT, NAXE CHANGES BY SWITCHIKG CARDS. 

3. PUT A BLANK CARD ON TOP OF EACH CATEGORY AND WRITE 
A TITIE FOR THE GROUP ON THE BLANK CARD. 

4. PUT THE CATEGORY GROUPS IN A SINGLE DECK. 

raMOGRAraics 

ID f (PLACE NUMBER ON EACH BLANK 

CARD USED FOR EACH CATEGORY) 

COURSE 

GENDER 

MAJOR 

CLASSIFICATION 

AGE THANK vqu 



t 
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ZNSTROCTIONS 

THE SORTING OF VXRBS IMTO CAIB6(ntIB8 

PURPOSE: THE PURPOSE OF THIS TASK IS TO STUDY YOUR VIEWS 
cm ClASSROON TEACHING BY USING A SET OF VERBS 
CHARACTERIZING TEACHING BEHAVIOR. YOUR VIEWS MAY 
REFLECT WHAT IS EXPECTED FROM A TEACHER IN ORDER 
TO FACILITATE LEARNING. 

YOUR TASK IS TO MAKE A JUDGMENTAL DECISION FOR 
EACH STATEMENT AND CREATE THESE PILES THAT WILL 
POSSES A COMMON CHARACTERISTIC. 

TASK DESCRIPnOM: 

1. START WITH THE FIRST VERB CARD. 

2. CONSIDER THE VERB IN TERMS OF YOUR VIEWS FOR 
FACILITATING LEARNING. 

3. US.^ THE FIRST CARD TO START YOUR FIRST CATEGORY. 

4. PICK UP THE NEXT VERB CARD. 

5. CONSIDER THE VERB IN TERMS OF YOU?. VIEWS FOR 
FACILITATING LEARNING IN RELATION TO THE VERBS 
AIREADY SORTED. 

6. DECIDE WHETHER YOUR IDEA FOR THIS VERB IS SIMILAR 
TO ONES ALREADY SORTED. 

IF YES, THEN PUT THE CARD IN THE CATEGORY GROUP 
YOU THINK IT BELONGS. 

IF HOT, THSN USE THE CARD TO START A NEW CATEGORY 
GROUP. 

7. PICK UP THE NE3CT CARD AMD REPEAT THE PROCESS. 
IF YOU ARE OUT OF CARDS: 

1. DECIDE IkHETHER YOUR CATEGORY GROUPS ARE A 
SATISFACTORY REPRESENTATION OF YOUR SORTING. 

2. IF NOT, MAKE CHANGES BY SWITCHING CARDS. 

3. PUT A BLANK CARD ON TOP OF EACH CATEGORY AND 
WRITE A TITI2 FOR THAT GROUP ON THE BUKK CARD. 



7*" 
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ZMSTRDCTZOMS 

m SORTING OF SZATBHENTS ZMTO dllGORZBS 

FORPOSB: THE PURPOSE OF THIS TASK IS TO STDDY YOUR Vl^S 
ON WHAT XT TAXES FOR A MQMAK TO HAXI IT TO THE 
TOP HER CIASS. THE STATEMENTS MAY APPLY TO WORK, 
FAMILY, AND SCHOOL SETTINGS. 

YOOR TASK IS TO MAKE A JUDGMENTAL DECISION FOR 
EACH STATEMENT AND CREATE THESE PILES THAT WILL 
POSSESS A COMMON CHARACTERISTIC. 

TASK OESCSIPIIOVS 

1. START WITH THE FIRST STATEMENT CARD. 

2. CONSIDER THE STATEMENT IN TERMS OF YOUR VIENS 
ABOUT WHAT IT TAXES FOR A WOMAN TO CONSIDER 
HKPgtLF SUCCESSFUL* 

3. USB THE FIRST CARD TO START YOOR FIRST CATEGORY. 

4. PICK UP THE NE3CT STATEMENT CARD. 

5. CONSIDER THE STATEMENT IN TERMS OF YOUR VIEWS 
ABOUT WHAT IT TAKES FOR A WOMAN TO BE TOP OF 
HER CLASS. (SAME IDEA AS IN 2) 

6. DECIDE WHETHER THE CHARACTERISTIC OF THIS NEW 
CARD STATEMENT ZS SIMILAR TO CARD STATEMENTS 
X2RBADY SORTED. 

IF YES, THEN PUT THE CARD IN THE CATEGORY GROUP 
YOU THINK IT BELONGS TO. 

IF HOI, THEN USE THE CARD TO START A NEW CATEGORY 
GROUP. 

7. PICK UP THE NEXT CARD AND REPEAT THE PROCESS 



IF YOU ARB OUT OF CARDS: 

1. raCIDB WHETHER YOOR CATEGORY ARB A SATISFACTORY 
REPRESENTATION 01' YOOR SORTING. 

2. IF NOT, MAKE CHANGES BY SWTL'CHING CARDS. 

3. PUT A BLANK CARD ON TOP OF EACn CATSGORY AND WRITE 
A TENTATIVE TITLE FOR THE GROUP ON THE BLANK CARD. 



APPENDIX C 

SAMPUI OF CASES FROM DATA SETS TO GENERATE 
JOINT PROPORTION MATRICES 



Data »mt tcr joint occurr«nc« aatrix for task X 

011000000000000000000010000010110 
012000000000010000000000001001000 
013000010000001100000000000100000 
014110001110000000000000000000000 
OlSOOOOOOOOOOOOOlOOllOOlO'lOOOOOOO 
016001000001100001000000QUOOOOOOO 
017000100000000000 100100 11000000 1 

02 1001100111001000001101001 10 1001 
O22OOOOOOOOOO0OOO1& . )010000000000 
023100010000000000000000000000100 
024000000000000010000900000000000 
025010001000100000110090110010010 
026000000000010100000000000000000 

031001000000011111111011001000000 
032110111111100000000100110111111 

041100010001000000000000000000000 
042000000000000000100000100000000 
04300000000001000000000000011 1 11 1 
044000000000000010011101000000000 
045000000000000000000000011000000 
046011101110000000000000000000000 
047000000000100000000000000000000 
048000000000001100000000000000000 
049000000000000001000010000000000 

051001100000011000000000001111110 
052110011111100111\11111110000001 

06111011111U .1100000000000111111 
062001000000100011011110000000000 
063000000000000000 1000011 11000000 

071000000000000000000000011101000 
072000000000011011111110100010110 
073100003110100100000000000000001 
074011110001000000000001000000000 

081000000000000000000000011000000 
082000000000100011111111100000000 
08300000000001110000000900011 1 111 
084111111111000000000000000000000 



Data s«t for joint oceurranea aatrices for task II 



OIIOCOUIOOOOOOOOOOIOIOOOIOIOOOOO 
012101000100010001000000000001001 
' 013000000010001100000000000010100 
014000000000100060000001000000000 
015010000001000010101010101000010 

021010000001000010101010100000010 
022101111110111101010101011111101 

031100111100111000010101000100000 
0320100000010000\0101010101011010 
033001000010000} JOOOOOOOOlOOOOlOO 
034000000000000C JlOOOOOOOOOOOOOOl 

041101000010011001000001000000001 
04201JOO00010OO01O1O1O1C1O1O11O1O 
043000101100000100010100010000100 
044000010000100000000000000100000 

051100101100001000010000000101000 
052001000000010100000000010010000 
053010000000000010101010101000010 
054000010000100000000101000000000 
055000000011000001000000000000101 

061010000001000010001010101011000 
062000011100111000000001000100000 
063 10010000000000 1 110000000000 Oil 
064 0010000100001000001 000 10000 100 

071010000000000010101010100000000 
072100010000001000000000000100001 
073000000900000000000001000001000 
074U01001011000100010100010000110 
075000100100110001000000001010000 

081001000011010100010100010011100 
082100111100101000100001100100001 
083010000000000010001010001000000 
084000000000000001000000000000010 

091010000001000010100010101000010 

0920010000:0000100000001000000100 

093000101100001000010000010001000 
09410r010000010001001000000000000 
095000000000100000000100000110001 
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